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ABSTRACT 


A  survey  of  the  methods  of  solving  the  integer  program, 

n  n 

£   c.x.  subject  to   £ 

j=l   3  D  j-1 


max   T   c.x.  subject  to   T   a. .x .  =  b .  (i=l , . . . ,m)  and 


x.    0  and  integer  (j=l,...,n)  is  presented.   Emphasis  is 
placed  on  methods  developed  since  1960  with  many  as  yet  un- 
published methods  presented.   Examples  are  given  for  the 
unpublished  methods. 
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1.    Introduction  and  Brief  History 

This  is  a  survey  of  the  progress  that  has  been  made  in 
the  solving  of  linear  programming  problems  when  variables 
must  take  on  integer  values.   The  field  is  divided  into  pure 
integer  programming,  when  all  the  variables  must  be  integers, 
and  mixed  integer  programming,  when  only  specified  variables 
must  be  integers.   The  subject  is  also  known  as  discrete 
programming  or  integer  linear  programming  abbreviated  to 
integer  programming  which  appears  to  be  the  preferred  term. 

The  integer  programming  problem  is  to 

n 
(1)   Maximize   )   ex. 


n 

=  b .   (i=l , . . . ,m) 


Subject  to   I   a. .x . 

i  =  l   ^  3 


x .  >_  0  and  integer   (j  =  l,...,n), 

where  for  simplicity  and  without  loss  in  generality  we  as- 
sume all  a. .,  c.,  b.  are  integer  valued  constants. 
ij'   j'  i        y 

There  are  five  approaches  capable  of  solving  problems 
of  this  type:   cutting  plane  methods,  primal  methods,  branch 
and  bound  methods,  partial  enumeration  methods,  and  dynamic 
programming  procedures.   These  various  methods  will  be  dis- 
cussed in  the  succeeding  sections. 

Although  an  attempt  is  made  in  this  thesis  to  delineate 
the  various  methods  of  solving  integer  linear  programs ,  there 
are  no  clear  cut  divisions.   Many  authors  have  grouped  branch 
and  bound,  branch  and  exclude,  and  dynamic  programming  tech- 
niques into  a  broad  category  of  partial  enumeration  methods. 


If  a  solution  of  (1)  as  a  linear  program  does  not  have 
the  required  integer  properties  then  methods  for  achieving 
it  must  be  invoked.   A  basic  approach  common  to  most  methods 
is  to  successively  deduce  supplementary  linear  constraints 
from  the  linear  constraints  of  (1)  and  the  integer  require- 
ments until  a  new  linear  program  is  obtained  whose  solution 
satisfies  the  integer  requirements. 

The  idea  of  new  constraint  generation  appears  to  have 
been  first  advanced  by  Dantzig,  Fulkerson,  and  Johnson  [7] 
in  1954  in  their  work  on  the  traveling  salesman  problem. 
In  19  58  Gomory  [11]  developed  a  systematic  method  for  new 
constraint  generation  in  his  "Method  of  Integer  Forms"  for 
solving  pure  integer  programming  problems  in  which  all  var- 
iables are  required  to  be  integer  valued.   This  method  guar- 
antees that  an  integer  solution  is  found  (if  any  exist)  in 
a  finite  number  of  steps.   In  1960  Gomory  devised  another 
method,  the  "All  Integer  Method",  which  requires  only  addi- 
tion and  subtraction  in  computation  provided  the  a. .  and  c. 
in  (1)  are  integer  valued.   The  above  algorithms  are  "dual 
methods"  and  as  such,  no  feasible  solution  to  the  problem 
of  interest  is  obtained  until  an  optimal  solution  is  found. 
There  is,  however,  a  method  which  provides  primal  integer 
solutions.   This  method  is  attributed  to  Gomory  but  liter- 
ature on  this  is  scarce.   Young  [21]  has  also  presented  a 
similar  algorithm  for  primal  integer  solutions. 

The  field  of  mixed  integer  programming  is  less  far  ad- 
vanced.  Gomory  [12]  has  extended  his  method  of  integer 


forms  to  deal  with  continuous  as  well  as  integer  variables. 
A  dual  decomposition  approach  due  to  Benders  [4]  has  been 
used  to  remedy  the  situation  of  a  mixed  program.   In  this 
approach  the  problem  is  partitioned  and  every  stage  of  the 
computation  involves  the  solution  of  two  subproblems,  a  pure 
integer  problem  and  a  linear  programming  problem. 

Other  approaches  to  solving  pure  and  mixed  problems 
have  been  proposed.   In  1960  Land  and  Doig  [20]  developed 
a  branch  and  bound  technique.   In  19  6  8  Greenberg  and 
Hegerich  [19]  developed  a  branch  and  exclude  algorithm  for 
the  special  "knapsack  problem"  which  was  extended  by 
Greenberg  [15]  to  the  more  general  problem. 

Partial  enumeration  techniques  have  also  been  devised 
by  Balas  [1]  and  [2]  in  his  "Additive  Algorithm"  and  "Dis- 
crete Programming  by  Filter  Method",  Goeffrion  [8]  in  his 
"Reformulation  of  Balas1  Algorithm  for  Integer  Programming", 
and  by  Glover  [10]  in  "A  Multiphase  Dual  Algorithm  for  the 
Zero-One  Integer  Programming  Problem" .   An  enumerative 
scheme  for  computation  of  knapsack  functions  by  Greenberg 
[18]  is  presented  in  this  paper. 

Dynamic  programming  procedures  have  also  been  devised 
to  solve  linear  programming  problems.   Two  methods  by 
Greenberg  [16]  and  [17]  are  presented;  one  for  the  knapsack 
problem  and  the  second  a  more  generalized  problem  of  integer 
programming . 


2.    Cutting  Plane  Methods 

Before  discussing  the  particular  algorithms  of  Gomory 

it  is  appropriate  to  define  some  terms  which  will  be  used 

throughout  the  discussion  of  the  algorithms.   A  "feasible 

solution"  is  a  solution  where  all  variables  that  are  required 

to  be  integer  are  integer  and  all  variables  that  have  to  be 

non-negative  are  non-negative.   Since  Gomory' s  methods  are 

expressed  more  neatly  in  terms  of  an  objective  function  to 

be  maximized  the  objective  function  will  be 

n 
(2)   Maximize  xA  =  )      c.x. 
0    j£l   3  3 

An  "optimal  feasible  solution"  is  a  feasible  solution 
which  yields  the  largest  value  of  xQ. 

In  the  original  method  for  pure  integer  programming, 
the  "Method  of  Integer  Forms" ,  one  starts  by  solving  the 
problem  by  ignoring  the  requirement  that  the  variables  must 
be  integer.   If  this  produces  a  solution  in  integers,  then 
the  problem  is  solved.   Otherwise  one  considers  the  expres- 
sion for  some  basic  fractional  variable  in  terms  of  the 
non-basic  variables.   Let  this  be 

n 


x  =  a  A  -   J   a.t. 
s     sO    .L~       si  "j 


where  t.  denotes  the  j    non-basic  variable. 
D 

Now  write  the  coefficients  a    in  the  form 

a  .  =  n  .  +  f  . 
SD     S]     s: 

where  the  n  .  are  all  integers  (positive  or  negative)  and 

the  f    are  fractions  such  that:   0  <  f  .  <  1  . 
S3  -  s: 


Next  consider  the  expression: 

n 

s  =  -f  n  +   7   f  .t .   e 
sO    .^   sj  3 

This  expression  must  be  an  integer  since  it  differs 


from  -x   by  an  integer.   Also,  it  cannot  be  less  than  -f  rt 
s  -1  -d  I  sq 

n 
since  the  expression  \      f  . t.  is  non-negative.   So   s   is  a 

j=l  SJ    3 

non-negative  integer  and  can  be  introduced  as  a  new  variable 

of  our  problem.   Its  value  at  the  current  trial  solution  is 

-f  „.      So  the  constraint  that  s  >  0  "cuts  off"  this  solution 
sO  — 

and  enables  us  to  continue  optimizing  using  the  dual  simplex 
method. 

Gomory's  second  method  for  pure  integer  programming, 
the  "All  Integer  Method" ,  proceeds  differently.   One  does 
not  start  by  solving  the  problem  in  continuous  variables 
since  this  method  involves  keeping  the  coefficients  integral. 
One  starts  by  making  the  problem  dual  feasible,  perhaps  by 
adding  an  artificial  constraint  that  the  sum  of  the  non-basic 
variables  is  less  than  or  equal  to  some  arbitrarily  large 
number.   After  this  every  pivotal  row  is  a  new  cut  generated 
in  such  a  way  as  to  make  the  pivot  equal  to  -1.   This  en- 
sures that  the  integral  tableau  remains  integral.   The  proce- 
dure for  generating  pivotal  rows  is  as  follows:   Suppose  x 
is  some  variable  that  is  negative  in  the  current  trial  solu- 
tion, then  express  x   in  terms  of  the  non-basic  variables  as 
c  s 

n 

x  =aA-   y   a.t. 
s     sO    .*•-   S]  ] 

where  a  ,-.  is  negative. 

sO      3 


Let  A  be  any  positive  quantity  and  write 
a  .  =  An   +  f 

where  n    is  an  integer  and 

0  <  f  .  <  A   . 
-  SJ 

Consider  the  expression: 

n 
s  =  n  A  -   7  n.t. 

This  expression  must  be  integral  and  positive  since 

n 
f  n  -     y     f  .t.  <  f  n  <  X  . 

sO    .L,   si  i  —  sO 

For  any  value  of  A  ,  n  n  <  -1  if  a  n  <  0 .   So  the  new  con- 
2  sO  —        sO 

straint  that  s  _>  0  "cuts  off"  the  current  trial  solution. 
The  pivot  can  be  made  equal  to  -1  by  taking  A  large  enough 
since  for  arbitrarily  large  A  all  n  .  will  be  0  or  -1  depend- 
ing on  whether  a  .  is  non-negative  or  not. 

Just  as  constraints  for  the  Method  of  Integer  Forms  can 
be  generated  from  linear  combinations  of  rows  provided  it  is 
integral,  constraints  for  the  All-Integer  Method  can  be  gen- 
erated from  linear  combinations  of  rows  provided  it  is  non- 
negative  . 

The  third  and  final  cutting  plane  method  which  we  will 
consider  is  Gomory's  method  for  the  mixed  integer  problem. 
This  method  is  similar  in  part  to  the  method  of  Integer 
Forms  in  that  one  first  solves  the  problem  ignoring  the  re- 
quirement that  any  variables  must  be  integral.   If  some  var- 
iable that  must  be  integer,  say  x  ,  equals  n  Q  +  f  _,  where 

n  A  is  a  non-negative  integer  and  0  <  f  n  <  1,  then  x^  can 
sO  r  r         —  sO  s 

be  expressed  in  terms  of  the  current  non-basic  variables  as 

10 


x  =  n  A  +  f  A  +  Ta  .t.  +  Vb  .t. 

s    sO    sO   ^  s]  ]    f;  s]  ] 

where  the  non-basic  variables  t.  are  divided  into  two  clas- 
ses such  that  all  a    >  0  and  all  b    >  0. 

sj  -  sj  - 

Consider  the  expression: 

c         .  v    s.       .  fs0 

sO 


+  Ta  .t.  +   -  %  Jb  .t.  . 

+  s3  i        i-fs0  £  s:  : 


This  expression  is  negative  at  the  current  trial  solution 
but  is  must  be  non-negative  for  any  integral  value  of  x  . 

9 

This  is  because  if  x   -  n  A  <  0,  then 

s     sO  —   ' 

s  >  -f  A  +  Ta  .t.  -  Tb  .t.  =-(x-nn)  >  0 
—    sO    £  sj  j         i  sj  j       s   sO   — 

and  ifx   -nA>l,  then 
s     sO  — 

1-f  n 
-    s  >  -(1-f  n)    -  Ya  .t.  +  Tb  .t.  =  x   -  n  n  >  0   . 

fs0   -     s0   ;  s:  j   £  sj  :   s   so  - 

So  s  >  0  and  this  is  a  valid  cut.   If  any  of  the  non-basic 
variables  must  be  integral  then  an  expression  for  x  plus  an 
integer  combination  of  the  non-basic  integer  valued  var- 
iables, such  that  a    <  f  „  or  b    <  (1-f  n)    for  all  such 

sj  —  sO      sj  —     sO 

variables  can  be  used. 


11 


11 

(3)   Maximize   V   ex. 


3.    Primal  Methods 

The  primal  approach  involves  progressing  from  one  fea- 
sible solution  to  another  with  a  larger  value  of  the  objec- 
tive function  or  else  proving  that  no  better  solution  can 
exist.   A  method,  attributed  to  Gomory,  and  conveyed  to  the 
author  in  private  conversation  with  Greenberg  is  a  method 
of  solution  to  the  general  problem 

n 

j  = 

n 

Subject  to   y   a..x.  =  b.    (i=l,...,m) 
J        >1   ID  D     i 

x.  >  0  and  integer. 
J  - 

Along  with  the  discussion  of  the  algorithm  will  be  an  illus- 
trative example  which  is 

(4)  Maximize  x,  +  x~ 
Subject  to  3  x.  +  2  x2  _<  7 

x,  ,  x_  >^  0  and  integer. 
Adding  a  slack  variable,  S,  to  our  constraint  equation  and 
making  a  substitution  x.  =  x.  and  x_  =  x2 ,  (4)  may  be  re- 
written as 

(5)  Maximize  x.  +  x« 

Subject  to  3  x.  +  2  L  +  S  =  7 

-  x,  +  x,  =  0 

-  x2  +  x2  =  0 


:l  '  x?  1.  ®    an^  integer. 
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Set  up  the  first  tableau  using  (5) .   This  is  the  following 


xl    x2    S    Xl    X2    b 


3 

2 

1 

0 

0 

7 

-1 

0 

0 

1 

0 

0 

0 

-1 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

with  the  last  row  of  the  tableau  the  coefficients  of  the 

objective  function.   Since  this  is  a  maximize  problem,  the 

pivot  column  will  be  the  column  where  the  coefficient  of 

the  objective  function  is  the  greatest.   In  this  case  our 

pivot  column  will  be  either  x.  or  x„.   Arbitrarily  select 

the  x,  column.   The  criteria  used  for  selection  of  the  pivot 

row  is 

b. 
min   ( — )  where  a  is  the  pivot  column, 
a,  >0   ai 

In  our  problem  the  pivot  element  is  3. 

We  divide  the  pivot  row  by  the  pivot  element  giving 

(6)        1    §   |    0    o   2 

Rewriting  (6)  gives  us 


or 


-2      17 
xl  +  3X2  +  3S  =  3 


(7)   |x2  +  §S  -  ^  =  2  -  xx  . 


Since  the  left  side  of  (7)  is  >  0  then  the  cut  is 


¥2  *V  i-k  ■ 
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Using  (6)  ,  we  take  the  greatest  integer  _<  the  elements 
of  the  pivot  row  giving  us 

1     0    0     0     0    2. 

We  must  always  keep  the  slack  variable,  S  in  our  case, 
and  the  original  variables,  x.  and  x~  ,  in  the  basis. 

Since  the  right  side  of  (7)  implies  x,  j<  2,  we  must 
add  a  slack  variable,  say  t,,  giving  us 

(8)  x1   +  t1  =  2  . 

We  now  eliminate  our  pivot  variable  x.  from  the  equa- 
tions in  our  tableau  by  using  (8). 

Next  we  determine  if  this  is  an  optimal  solution.   If 
not  we  must  repeat  this  procedure.   If  our  pivot  element  is 
1  at  any  step,  we  must  modify  the  procedure  by  substituting 
dummy  variables  for  the  variable  we  want  to  keep  in  the 
basis. 

Continuing  with  our  example  and  using  (8)  our  next 
tableau  is 

H        *2    S    xx    x2    b 

-3     2    1  0     0    1 

10    0  10    2 

0-10  0     10 

-110  0     0    2. 
Note  that  the  x.  column  has  been  eliminated. 

Our  next  iteration  allows  us  to  eliminate  x«  from  the 

basis  by  rewriting  line  one  of  the  tableau  as 

-  — t,  +  x   +  — S  =  —   or    -2t,  +  x„  =  0 
2  1     2    2     2  1'    2 
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Substituting  x2  =  2t,  -  t2  in  our  tableau  gives 


H 

fc2 

s 

Xl 

x2 

b 

i 

-2 

1 

0 

0 

1 

i 

0 

0 

1 

0 

2 

-2 

1 

0 

0 

1 

0 

1 

-1 

0 

0 

0 

2 

Using  the  column  headed  by  t,  as  our  pivot  column  now 
requires  the  use  of  our  modified  procedure  since  our  pivot 
element  is  1. 

Writing  line  one  of  the  above  tableau,  not  including 
S,  gives 

tx  -  2t2  <  1   . 

Adding  a  slack  variable  t,.  gives 

t,  -  2t2  +  t3  =  1 

or  t,  =  1  +  2t2  -  t3 

Substituting  this  in  our  previous  tableau  and  elimina- 
ting the  t,  column  gives 


t3 

4 

S 

xl 

x2 

b 

-1 

0 

1 

0 

0 

0 

-1 

2 

0 

1 

0 

1 

2 

-3 

0 

0 

1 

2 

-1 

1 

0 

0 

0 

3 

Using  the  column  headed  by  t2  as  our  pivot  column 
allows  us  to  eliminate  t~„ 


15 


Writing  line  two  of  the  above  tableau  after  dividing 
by  the  pivot  element  gives 

-  it    +  t    +  ix    -  i 

2^3    ^2  *  2X1    2 
and  using  our  procedure  gives 

-t3  +  t2  <_  0 

Adding  a  slack  variable,  t,  to  this  equation  allows  us 
to  substitute 

t2   =  t3    t4 


in  our  tableau  giving 

fc3 

tA 

S 

xl 

x2 

b 

-1 

0 

1 

0 

0 

0 

1 

-2 

0 

1 

0 

1 

-1 

3 

0 

0 

1 

2 

0 

-1 

0 

0 

0 

3 

which  is  an  optimal  solution  with  x,  =1,  x2=2rs=0, 
and  3  as  the  value  of  the  objective  function. 

In  this  problem  there  is  an  alternate  solution  indica- 
ted by  the  0  element  in  the  last  row  of  the  t3  column  in 
the  previous  tableau. 

Continuing  with  our  procedure  and  using  the  t^  column 
as  the  pivot  column,  we  obtain  an  alternate  optimal  solution 
of  x,  =  0,  x9  =  3,  s  =  1,  and  3  as  the  value  of  the  objec- 
tive function. 


16 


4 .    Branch  and  Bound  Methods 

A  third  approach  to  the  integer  programming  problem  is 
the  branch  and  bound  technique.   This  involves  setting  up 
a  tree  of  linear  programming  problems.   The  root  of  the  tree 
is  the  problem  in  which  all  integrality  constraints  are 
ignored.   If  the  solution  satisfies  the  integer  requirements 
then  the  problem  is  solved.   Otherwise  a  branching  procedure 
is  employed  to  obtain  an  integer  solution  to  the  problem. 

Three  methods  will  be  discussed  in  this  section.   The 
first  is  the  Land  and  Doig  procedure  [20]  which  was  pub- 
lished in  19  60,  the  second  method  by  Greenberg  and  Hegerich 
[19]  which  was  devised  in  1968  and  applied  to  the  knapsack 
problem,  and  the  third  method  by  Greenberg  [15]  in  19  68 
which  was  an  extension  of  [19]  to  the  more  generalized 
problem. 

The  general  approach  of  the  Land  and  Doig  procedure  is 
to  solve  the  integer  program  ignoring  the  integrality  con- 
straints.  If  the  solution  X  =  (y.  ,x.  ,  „  .  .  ,x   )  satisfies 

•*  0   1      m+n 

the  integrality  constraints  the  problem  is  solved.   If  not 
then  the  present  value  yQ  of  the  objective  function  provides 
an  upper  bound  on  the  value  of  the  optimal  solution  to  the 
integer  program. 

A  variable  x,  which  is  required  to  be  integer  valued 
but  currently  is  not,  is  considered.  The  variable  must  be 
forced  to  take  on  an  integer  value  hence  decreased  to  [x,  ] 
or  increased  to  at  least  [x,]  +  1  where  [x,]  is  the  great- 
est integer  less  than  or  equal  to  x,  .  The  entire  range  of 
possible  integer  values  for  x,  may  be  found  by  solving  the 

17 


two  linear  programs  max  x,  and  min  x,  subject  to  the  con- 
straints of  (2) .   For  each  possible  integer  value  in  the 
range  the  max  yQ  subject  to  the  constraints  of  (2)  with  x, 
fixed  can  also  be  computed  by  linear  programming.   Thus,  5 
all  possibilities  in  the  form  of  a  directed  tree  can  be 
enumerated  with  the  root  of  the  tree,  with  rooted  node  0, 
corresponding  to  X  ,  and  directed  branches  (0,i)  with  node 
i  corresponding  to  the  solution  X   of  the  linear  program 
max  y0  subject  to  the  constraints  of  (2)  and  x,  set  at  some 
specific  integer  value,  say  x,   .   From  each  new  node  the 
same  procedure  can  be  applied.   Continuing  until  no  further 
branching  is  possible,  every  terminal  node  will  either  cor- 
respond to  a  feasible  integer  solution  or  to  some  sequence 
of  integer  valued  choices  which  do  not  satisfy  (2) .   The 
feasible  node  with  max  yQ  provides  the  optimal  solution. 

The  Land  and  Doig  procedure  involves  this  enumeration 
but  attempts  to  search  only  a  subset  of  the  possibly  immense 
tree  described.   The  idea  is  to  develop  only  that  part  of 
the  tree  which  contains  the  optimal  solution.   Any  node  in 
the  directed  tree  must  have  a  value  of  yQ  no  greater  than 
its  predecessors1  since  branching  is  imposing  an  additional 
variable  to  some  integer  value,  i.e.,  imposing  an  additional 
constraint.   Also  if  at  any  node  X   of  the  tree,  x  is 
integer  restricted  and  x   '  is  not  integer  then  the  integer 

values  for  x  which  will  result  in  the  least  decrease  in  y~ 
p  u 

after  branching  must  be  either  [x(l)]  or  [x'5l)  ]  +  1.   Thus 

'  P         P 

we  have  reduced  the  total  number  of  branches  that  need  be 
explored. 
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Another  approach  to  the  branch  and  bound  or  more  pre- 
cisely branch  and  exclude  method  is  that  of  Greenberg  and 
Hegerich,   Their  original  work  was  with  the  knapsack  problem 
and  later  extended  by  Greenberg  to  the  generalized  integer 
programming  problem. 

They  present  a  branch  and  bound  algorithm  and  a  branch 
and  exclude  procedure  which  is  used  to  solve  the  problem 

n 

(9)   Maximize    T   v.x, 

S   i  i 
i=l 

n 

Subject  to    T   w.x.  <  W 
J         ,  L ,   l  l  — 
1=1 

x.  =  0,1   (i-1, ,  „  .  ,n) 

It  is  assumed  that  v.  and  w.  are  positive  integers  and 

Vwl  -  v2/w2  -  '••  -   vn/wn* 

The  problem  is  first  solved  as  shown  by  Dantzig  [6] 
where  the  0  <   x    1.   This  solution  is  given  by 

x.  =  1   if  i  <  r 

i 

x.  =  0   if  i  >  r 

l 


x  = 


w  -  y   w. 

i  <  r 


r         w 
r 

where  r  is  the  least  integer  (0    r   n)  for  which 

y   w.  >  W.   If  no  r  exists  then  all  x.  =  1.   If  x„  =  0, 
t    i  —  l  r 

i    r 

then  we  have  the  optimal  solution  to  (9) . 

If  x   is  fractional  the  value  of  the  objective  function 
r  J 

is  Z(l)  =    I      v.  +  v  x  .   Z(n)  is  the  value  of  the  objective 
i  <  r 
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function  at  node  n.   The  branch  and  bound  method  is 
1.      Label  node  1  with  Z(l). 
2(a).   Find  the  terminal  node  with  the  largest 

value  of  Z(n).   This  is  the  node  at  which 
the  next  branching  will  take  place.   Any 
node  (except  one)  contains  the  effect  of 
assigning  values  to  variables  and  solving 
(9)  with  the  assigned  values  of  the 
variables  added  as  constraints, 
(b) .   If  the  solution  at  node  n  has  all  variables 
assigned  an  integer  value,  this  is  the 
optimal  solution  to  (9).   If  not,  proceed 
to  step  3. 
3(a).   Set  n  =  n  +  1  and  some  unassigned  variable, 
say  x.  to  0.   Solve  (9)  with  all  assigned 
variables  added  as  constraints.   Label 
node  n  with  the  value  Z(n)  and  proceed  to 
3(b)  . 
(b) .   Set  n  =  n  +  1  and  x  =  1.   Solve  (9)  with 

all  assigned  variables  added  as  constraints. 
Label  node  n  with  the  value  Z(n)  and  go  to 
step  2. 
The  criteria  used  to  select  x,  in  step  3(a)  is  to  take 
the  variable  that  is  fractional  at  node  n. 

As  is  common  with  most  branch  and  bound  techniques  they 
require  large  amounts  of  computer  storage.   The  branch  and 
exclude  algorithm  which  is  described  next  is  designed  to 
eliminate  the  problem  of  storage.   The  algorithm  first  finds 
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an  obvious  integer  solution  to  the  constraints  of  (9) .   This 
solution  is  taken  as  a  lower  bound  to  the  optimal  solution. 
A  branch  of  a  tree  is  developed  and  each  part  explored  until 
the  lower  bound  is  reached  or  until  a  new  feasible  solution 
is  found  that  represents  a  larger  lower  bound.   Then  back- 
track and  develop  new  branches  of  the  tree  developing  pos- 
sibly larger  lower  bounds.   Further  branching  is  excluded 
when  the  lower  bound  is  reached.   The  algorithm  stops  when 
all  new  branches  are  excluded.   The  only  information  that  is 
stored  is  the  current  lower  bound  solution  and  the  branch 
routing.   At  the  end,  the  lower  bound  solution  is  optimal. 
Before  the  algorithm  is  presented  certain  terms  must 
be  defined* 

Define  S (x~ ,xn , . . . ,x  )  as  the  current  lower  bound  solu- 
0 '  1'    '  n 

n 
tion  where  the  x.  are  all  given  and  xn  =   T   v.x. . 

i=l 

Define  X(x. ,x~ , . . . ,x  )  to  indicate  assigned  variables, 
l '  2     '   n  r 

A  value  x.  =  2  (or  any  number  not  equal  to  zero  or  one) 
indicates  the  variable  is  unassigned.   An  assigned  variable 
will  have  the  value  zero  or  one. 

Define  R(L)  as  the  index  of  the  L   assigned  variable. 

Define  Z (L)  as  the  value  of  the  objective  function  at 
the  L    level  of  a  branch, 

The  solution  to  (9),  with  L  assigned  components  of  X 
added  as  constraints  is 

x.  -  1  if  i  <  r,  i  f&   R(j)   (j=l,..,,L) 

x,  =  0  if  i  >  r,  i  f  R(j)   (j=l,...,L) 
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(10)       xr(m    =    °    or   1    (j-1, . . . ,L)    depending   on   the 
assignment 

L 

x     =    (W  -      I   wRmx    m    -  I      w.)/w 

r  i=1   R(i)    R(i)         ieM(L)    i        r 

Z(L+1)    -      I   VR(i)XR(i)    +    .    LT/i   + 
1=1  ieM(L) 


v  x 
r   r 


where  the  set  M  is  given  by 

M(L)  =  {i|i  <  r,  i  j-   R(j)   (j=l,...,L)} 

and  r  is  the  least  integer  (0  <_   r  ■:  N)  for  which 

L  L 

I        w.  +  w   >  W  -   [w  (i)x  ,.,   . 
ieM(-L)  x    r       i-1  RU)  RU) 

If  no  r  exists  we  have  all  x.  =  1  for  i  f   R(j)  ( j=l , . . . ,L) . 
A  lower  bound  to  the  solution  of  (9)  is  given  by 

L 

X(L)  =  XvR(i)xR<i)  +  .  LT.vi    • 

1=1  i£M(L) 

The  algorithm  is  as  follows: 

1.  Set  L  =  1  and  all  components  of  X  to  two. 

2.  Solve  (9)  with  0  <  x.  <  1.   If  the  solution  is  all 

—  l  — 

integer  then  this  is  the  optimal  solution.   If  not,  the  solu- 
tion is  x,  =  1,  x2  =  l,...,x   ,  =  1  and  x   is  fractional. 

Calculate  xQ  =    I   v.  and  form  S (xQ ,1,1 , . . . ,1,0 ,0 ,0)  as  a 

i  <  r  1 

lower  bound  to  the  optimal  solution,  where  the  zero  compo.*- 

nents  in  S  represent  x.  =0,  i   r.   Set  R(l)  =  r  and  the 

th 
r   component  of  X  to  zero. 

3(a).   Solve  (9)  with  the  L  assigned  components  of  X 

added  as  constraints.   We  obtain  (10).   If   [Z (L  +  D ]  <   xQ 
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go  to  step  4.   If  Z (L+l)  >  xQ  and  we  have  an  integer  solu- 
tion, take  xQ  =  Z(L+1),  form  a  new  S  (xQ  ,x.,  , . .  .  ,x  )  from  (10) 
and  go  to  step  4.   If  [Z(L+1)]  >  xQ . and  we  do  not  have  an 
integer  solution,  go  to  3(b). 

(b) .   If  x(L)  >  xQ ,  take  xQ  =  x(L)  and  form  a  new 
S (Xq,x,, . . . ,x  )  from  (10)  with  x  =  0.   In  any  case,  set 
L  =  L  +  1,  take  R(L)  =  r,  and  set  the  R(L)  component  of  X 
to  zero  and  go  to  3(a). 

4(a).   If  the  R(L)  component  of  X  is  equal  to  zero 
change  the  component  to  one  and  go  to  3(a).   If  the  R(L) 
component  of  X  is  one  go  to  4 (b) , 

(b) .  If  L  =  1,  the  optimal  solution  is  S (xQ ,x. , . . .  , 
x  ).  If  L  7^  1,  change  the  R(L)  component  of  X  to  two,  set 
L  =  L-l,  and  go  to  4(aK 

This  completes  the  algorithm.   R(L)  represents  a  rout- 
ing of  assignments  along  the  branch.   Only  one  branch  is 
studied  at  a  time  with  preference  given  to  assigning  the 
value  of  zero  to  the  fractional  variable,,   This  allows  lower 
bounds  to  be  achieved  more  rapidly .   The  only  permanent 
storage  information  required  is  the  current  lower  bound  solu- 
tion S,  the  assigned  variables  R(L)  at  level  L  of  the  branch, 
and  the  assignment  vector  Xc 

An  extension  of  the  previous  algorithm  is  that  of  Green- 
berg  [15]  in  which  he  presents  an  algorithm  for  the  solution 
of  the  integer  programming  problem 
(11)   Minimize   Z  =  CX 
Subject  to  AX  ■  B 

0  £  x .  <_  b . ,  x   integer,  j=l, . - . ,n, 
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where  C  is  an  n-vector,  B  is  an  m-vector,  A  is  an  mxn  matrix 
and  the  b.  are  positive  integers.   Any  or  all  of  the  b.  may 
be  infinite.   It  is  assumed  that  the  elements  of  C,  B  and 
A  are  integers. 

The  two  phase  simplex  method  is  used  to  solve  (11)  to- 
gether with  the  bounded  variable  technique  of  Dantzig.   After 
solving  (11)  as  a  linear  program,  the  condition  x,    [x,  ]  or 
xk  —  '■xk"'  +  *"  *"or  a  ^asic  variable  x,  with  its  value  x,  as 
fractional  is  imposed.   The  solution  for  the  linear  program 
is  then  infeasible.   Then  x,  is  placed  at  either  the  new  up- 
per bound  [x,]  or  at  a  lower  bound  [x,  ]  +  1 ,  an  artificial 
variable  equal  to  the  amount  of  the  infeasibility  produced 
(x,  -  [x,]  in  the  first  case  or  [x,  ]  +  1  -  x,  in  the  second 
case)  is  added,  and  the  new  bounded  variable  problem  is 
solved  by  the  two  phase  procedure.   If  a  solution  is  obtained 
to  the  new  problem  that  is  fractional,  an  additional  condi- 
tion x_  <  [x  ]  or  x   >  [x  ]  +  1  is  imposed  for  a  basic  var- 
r  —   r      r  —   r 

iable  x  with  its  value  x  as  fractional.  The  new  problem 
is  then  solved  maintaining  the  constraint  of  x,  .  This  proc- 
ess is  continued  until  it  is  necessary  to  backtrack  which  is 
done  by  simply  removing  the  bounds  on  the  required  variables 
and  solving  the  linear  program  to  return  to  a  previous  prob- 
lem. Note  that  bounds  on  the  same  variable  may  appear 
again;  the  initial  bounds  will  automatically  be  satisfied. 

This  entire  procedure  enumerates  possibilities  for  the 
solution  to  (11)  in  a  directed  tree.   The  rooted  node  cor- 
responds to  Z  .   Only  one  branch  is  investigated  to  the  next 
node  corresponding  to  the  solution  of  (11)  with  say 
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x,    [x,  ]  +  1  representing  the  branch.   From  each  node  the 
same  procedure  is  repeated  investigating  one  branch  until 
we  backtrack  to  a  previous  node  that  has  had  only  one  branch- 
ing.  For  example,  we  would  branch  to  a  node  corresponding 
to  the  solution  of  (11)  with  x,    [ xQ ]  representing  the 
branch  when  we  backtrack  to  the  rooted  node.   Any  further 
backtracking  to  the  rooted  node  would  end  the  problem.   This 
procedure  is  contained  in  the  following  algorithm: 

Define  S (xQ ,x. , , . . ,x  )  as  the  current  upper  bound 
solution,  which  represents  a  feasible  integer  solu- 
tion to  (11)  with  objective  value  xQ . 
Define  I (L)  as  the  index  of  the  L —  bounded 
variable. 

Define  N(L)  to  show  the  number  of  branchings  for 
the  L—  bounded  variable  (Initially  N(L)  =  0). 
Define  B (L)  to  show  the  bound  on  the  L —  bounded 
variable. 

Define  G(L)  =0  to  indicate  the  L —  bounded 
variable  is  <_  B(L)  ,  and  G(L)  -   1  to  indicate  the 
L —  bounded  variable  is   B(L) . 
1.    Set  L  =  0  and  take  S(x.,x.,...,x  )  as  a  feasible 
integer  solution  to  (11) .   If  none  is  apparent 
take  xQ  as  infinite.   Solve  (11)  as  a  linear  program. 
If  the  solution  is  all  integer  the  problem  is  solved. 
Otherwise  go  to  2  maintaining  the  canonical  form  of 
the  solution  to  (11) . 
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2.  Set  L  =  L  +  1.   Go  to  2(a). 

(a)  Select  a  basic  variable  that  is  fractional. 
Suppose  the  variable  selected  is  x,  with 
value  x,  ,  set  I (L)  =  k ,  N(L)  =  1  and  go  to 
2(b)  or  2(c)  . 

(b)  Set  B(L)  =  [x£]  and  G(L)  =  0.   Go  to  3 

(c)  Set  B(L)  =  [x£]  +  1  and  G(L)  =  1.   Go  to  3. 

3.  Solve  the  linear  program  using  the  maintained  canonical 
form  with  the  new  bounds  on  the  variable  x,  where 

k  =  I (L) .   One  of  the  cases  holds : 

(a)  If  the  solution  produces  an  objective  value  Z 
with  [Z]  +  1  >  xQ  to  to  4. 

(b)  If  the  solution  produces  an  objective  value  Z 
with  [Z]  +1  <  xQ  and  the  solution  is  all  integer, 
redefine  S (xQ ,x, , . . . ,x  )  as  a  new  feasible  integer 
solution  where  xQ  =  Z,  x,,...,x  is  the  new  solu- 
tion.  Go  to  4. 

(c)  If  the  solution  produces  an  objective  value  Z 
with  [Z]  +  1  <  xQ  and  the  solution  is  fractional 
go  to  2 . 

(d)  If  the  problem  has  an  infeasible  solution  go 
to  4. 

4.  Set  LL  =  L  and  go  to  4(a). 

(a)  If  N(L)  =  2,  go  to  4(b).   Otherwise  N(L)  -  1; 
go  to  4 (c) . 

(b)  If  L  =  1,  the  feasible  solution  S (xQ ,x, , . . . ,x  ) 
is  optimal.   Stop.   Otherwise  set  N(L)  =  0, 

L  =  L-l,  and  go  to  4(a). 
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(c)  Solve  the  linear  programming  problem  starting 
from  the  current  canonical  form  with  the  bounds 
B(L),  B(L+1) ,. r  . ,B(LL)  removed.   If  k  =  I (L) 
and  x,  does  not  become  a  basic  variable  then 
the  solution  is  non-unique;  x,  is  then  made  a 
basic  variable.   Go  to  4(d). 

(d)  If  G(L)  =  0,  set  B(L)  =  B (L)  +  1,  N(L)  =  2,  and 
go  to  3,   Otherwise  G(L)  =  1;  set  B(L)  =  B (L)  -  1, 
N(L)  =  2,  and  go  to  3. 

It  should  be  noted  in  this  algorithm  the  bounds  are 
changed  systematically  until  the  optimal  integer  solution 
is  produced,,   The  method  results  in  a  branching  process  that 
requires  minimum  excess  computer  storage  over  that  required 
to  solve  the  linear  programming  problem. 

In  addition,  dynamic  programming  enumeration,  similar 
to  that  given  in  [17 J  and  developed  in  the  dynamic  program- 
ming section  of  this  thesis,  may  be  instituted  after  a  frac- 
tional solution  is  obtained  at  any  node  to  speed  the  calcula- 
tions. 

To  illustrate  the  basic  method,  an  example  from  [3]  is 

presented  where  the  variables  are  arbitrarily  picked  for 

branching  and  the  branching  is  always  taken  with  a  greater 

than  or  equal  sign  first ,   The  problem  is  to 

min   4x.  +  5x2 

when  3x1  +   x2  -  x^  =  2 

x,  +  4x2  -  x,  =  5 

3x,  +  2x~  -  xc  -  7 
1      2     5 

x, ,  x2 ,  x~ ,  x. ,  x5    0  and  integer. 
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The  continuous  solution  produces  the  canonical  form 

_2  4       18 

Xl  +  10x4    10X5  "   10 


x2  "  10X4  +  10X5  " 


10 


3     11      42 

X3  +  10x4    10X5     10 


.     7      11      _112 
'*        10X4  +  10X5  "   TO" 


Since  the  solution  is  fractional  we  arbitrarily  select  the 
bound  x.  >_  2  added  to  the  previous  canonical  form.   We  then 
obtain  the  canonical  form 

2    4  1   4  4     4 

11     1       3 
X3     4~X1  "  4X4  "  "  4" 

5      19 
X5     2X1    2  4  ~  "  2 

-Z  +  1Xx  +  5x   ■  -25 
-Z  +  -Tx1  +  ?x4  -  — j 

where  (z /x1/x2/x3 ,x4 ,xg)  =  (47/4,  2,  3/4,  19/4,  0,  1/2). 
We  arbitrarily  select  x2    1  and  solve  the  previous 
canonical  form  with  x.    2  and  x2   1  to  obtain  the  canonical 


form 


X3  "  3xl  ~   x2  ~  ~2 


<rt*    ""        1  "™   "  *»  #>*   —   *  J 


X5  ~  3xl  "  2x2  =  "^ 


-Z  +  4x,  +  5x2  = 


where  (z ,x, ,x2,x3 ,x4 ,x5)  =  (13,  2,  1,  5,  1,  1),  which  is  all 
integer  and  becomes  the  solution  vector  S (xQ ,x. , . . . ,x  ) . 
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We  then  remove  the  bound  x2    1  and  apply  the  simplex  proce- 
dure on  the  previous  canonical  form  (e.g.,  Z  may  be  decreased 
by  decreasing  x2)  and  obtain  the  same  canonical  form  that  we 
obtained  by  selecting  the  bound  x,    2.   We  them  impose  the 
bound  Xp    0  on  this  canonical  form  in  addition  to  x.  >  2 
and  obtain  the  canonical  form 

xl  +   4x2     x4  ~    5 
x^  +  llx2  -  3x.  -      13 

x5  +  10x2  -  3x4  =    8 

-Z  -  ll.x2  +  4x4  =  -20 

where  the  solution  is  (20,  5,  0,  13,  0,  8).   Since  Z  >  13  we 

remove  the  bounds  x~    0  and  x.    2  and  solve  the  previous 

canonical  form  to  obtain  our  first  canonical  form  again. 

We  then  take  x..    1  and  obtain  the  canonical  form 

3     17 
X2  +   2X1    2X5  ~   2 

3     17 

X3  "   IX1    2X5  "   2 

x.  +   5x.  -  2xc  =  9 

4       15 

"Z  "   2X1  +  IX5  =  1 — 
where  (z/x1,x2 ,x3,x4 ,x5)  =  (14,  1,  2,  3,  4,  0).   Sinze  Z  >  13 

the  problem  is  solved  with  solution  Z  =  13 ,  x,  =  2 ,  x2  =  1 , 

X-   =   5,    X.   ■   1,   Xr   =   1» 

The  advantages  of  this  basic  branching  algorithm  are 
apparent  over  the  Land  and  Doig  procedure  even  in  this  small 
example.   This  same  problem  solved  using  the  Land  and  Doig 
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procedure  as  illustrated  in  [3]  required  the  generation  of 
five  nodes.   This  algorithm  required  only  four.   Further, 
no  additional  problems  are  generated  except  that  the  canon- 
ical form  from  the  original  continuous  solution  is  varied 
depending  on  the  bounds  on  the  variables.   Each  problem 
leads  into  the  next  in  a  natural  fashion. 
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5,    Partial  Enumeration  Techniques 

A  fourth  approach,  partial  enumeration,  is  basically  a 
branch  and  exclude  method  with  various  rules  envoked  for  the 
purpose  of  exploring  only  certain  branches  of  the  tree. 

A  method  for  partial  enumeration  by  Balas  [1]  is  pre- 
sented for  the  case  where  x. > ( j=l, . . . ,n)  equals  0  or  1 .   The 
problem  to  be  solved  should  be  formulated 

n 
(12)   Maximize  y_  =   )   c  x.  +  bA 

0    j£X   :  3     0 

n 
Subject  to  y .  =  b ,  +   T   a   x,  >  0 

j=l         J    J 

(i=l,...,m)  and  x .  -  0  or  1,  (j=l,.*.,n). 

In  (12) ,  all  c,  must  be  non-positive.   If  this  is  not 
the  case,  x  may  be  replaced  by  (1-x.)  for  any  c.  >  0.   Also, 
some  b.  must  be  negative  or  the  problem  has  the  trivial  solu- 
tion with  all  x.  =0, 

There  are  2   different  possible  solutions.   The  algor- 
ithm seeks  to  find  an  optimal  feasible  solution  or  knowledge 
that  none  exists  without  having  to  evaluate  each  of  the  2 
possible  solutions.   The  algorithm  is  in  the  form  of  a  tree 
search.   A  path  along  the  tree  of  solutions  is  traced  until 
either  a  new  feasible  solution  is  obtained  or  a  node  is 
reached  which  yields  information  that  all  solutions  in  which 
that  particular  node  is  included  may  be  ruled  out  of  consid- 
eration.  The  process  then  backtracks  to  the  unique  node 
that  immediately  precedes  the  one  ruled  out  and  departs  that 
node  on  a  different  path  unless  none  are  left  and  it  becomes 
necessary  to  backtrack  further.   When  the  process  is  pushed 
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back  to  the  starting  node  and  information  is  obtained  that 
no  other  branches  of  the  tree  need  be  explored,  the  algorithm 
terminates . 

Define  Sn  to  be  the  set  of  variables  presently  set  equal 
to  zero  and  S,  as  the  set  of  variables  presently  assigned  a 
value  of  zero  or  one. 

Record  the  value  of  yn  for  the  current  best  known  solu- 
tion.  Call  this  value  y0b.   Record  the  current  values  of 

yA/  y, ,... ,y   as  yn  ,  y,  ,  ...,y    and  the  maximum  possible 
2  0  2 1     -^m    -'Oc'  Jlc'    'Jmc  v 

values  of  y1 ,y2  , , . .  ,y   as  ylm'Y2m' ' *  * 'ymm  obtained  bY  chang- 
ing the  variables  in  Sn  so  that 

Yim  =  Yic  +  ^  max(0'aii)   (i=l,...,m) 
J  J 

and  j  is  the  set  {j:   x.  e  Sn}  . 

Initially  yQ,  may  be  set  equal  to  -°°  and  the  current 
subproblem  has  all  variables  in  S-.   The  general  nature  of 
the  algorithm  is: 

1.  Consider  a  subproblem.   If  yQ  <_   yQ,  abandon  the 
subproblem.   Otherwise  if  all  y .   _>  0  for 
(i=l,...,m)  a  new  best  feasible  solution  is 
found.   Abandon  the  subproblem  since  all  c.  _<  0 
and  it  is  unprofitable  to  assign  any  variable  in 
SQ  a  non-zero  value. 

2.  Otherwise  if  c.  <  yQ,  -  yQ   for  any  j,  put  x. 

in  S,  and  assign  it  a  value  of  zero.   Revise  the 

values  of  y.  .   If  and  revised  y.   <  0,  abandon 

2 lm  Jim 

the  current  subproblem  because  it  cannot  have  a 
feasible  solution. 
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3.   If  y    +  a. .  <  0  for  some  i,  put  x.  in  S,  wi 


th 


an  assigned  value  of  zero  and  revise  the  v*  . 

J  1m 

This  should  be  repeated  for  each  y.   since  a 

u  1m 


variable  was  last  assigned  to  S,  or  until 


some 


y,   <  0. 

2  lm 


4.   Ify.   -a.   <0  for  some  i,  put  x.  in  S,  wi 


th 


an  assigned  value  of  one.   Revise  all  y.   and 

2  lm 
5.   If  no  x,  is  assigned  a  value  of  one  in  step  4, 

a  branch  must  be  made,   A  variable  in  S-.  is 

assigned  to  S,  with  a  value  of  one  and  at  the 

same  time  a  new  subproblem  is  set  up  that  is  the 

same  as  the  current  one  except  that  the  variable 

is  assigned  a  value  of  zero.   The  choice  of 

variable  is  made  by  taking  that  variable  that 

when  set  equal  to  one  increases  at  least  one 

negative  y.   and  makes  the  greatest  decrease  in 

m 
the  sum  \   max  (0,-y.  ).   If  two  or  more  var- 
i=l         1C 

iables  are  tie,  the  one  with  the  largest  c.  is 

used. 
An  algorithm  by  Glover  [10]  which  in  its  simplest  form 
is  similar  to  the  "All  Integer  Method"  of  Gomory ,  but  rep- 
resents a  weakening  of  the  constraints  of  this  algorithm 
was  also  a  proposal  for  sharpening  the  tests  of  the  algor- 
ithm of  Balas  [1]  and  hence  reducing  the  size  of  the  solu- 
tion tree. 
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Geoff rion  [8]  outlined  a  version  of  the  algorithm  by 
Balas  [1]  which  lends  itself  to  computer  implementation. 

Balas'  [2]  filter  method  is  an  accelerated  version  of 
his  earlier  "additive  algorithm".   In  the  filter  method  a 
two  phase  approach  is  used  where  in  phase  I  an  auxiliary 
problem  is  constructed  that,  in  phase  II,  is  used  to 
"filter"  the  solutions  to  which  the  tests  of  the  additive 
algorithm  are  to  be  applied. 

Clever  enumerative  schemes  are  in  certain  situations 
the  best  methods  of  solution.   An  algorithm  for  the  computa- 
tion of  knapsack  functions  by  Greenberg  [18]  falls  in  this 
category  where  the  problem  is 

n 
(13)   Maximize    Y   c.x. 

n 
Subject  to    I      a.x.  =  L 

j=l  3  3 

x.  >  0,  and  x.  integer, 

D  -       : 

where  each  c .  is  a  positive  number,  each  a .  is  a  positive 
integer,  and  L  is  a  positive  integer.   In  the  usual  knap- 
sack problem  the  constraint  in  (13)  is  an  inequality  con- 
straint.  It  can  be  assumed  in  this  formulation  that  slack 
variables  have  been  added  to  convert  the  inequality  to 
equality. 

The  one-dimensional  knapsack  function  is  defined  from 
(13)  as: 


x  .  integer  } . 


If  F(x)  can  be  found  for  all  values  of  x  and  in  turn 
the  x.  found  that  produces  the  solutions,  then  (13)  is 
solved  when  F(L)  is  found. 

The  knapsack  function  can  be  written  as 

(15)  F(x)  =  max       [c.  +  F(x-a.)] 

i  :a  .  <  x    -1 

with  initial  condition  F(0)  =  0,  for  values  of  x  that  are 
feasible. 

One  immediate  solution  to  (15)  can  be  found  by  find- 
ing a   =  min  a.,  for  all  j.   This  produces  F(a  )  =  c  . 
Then  replace  x  by  x  -  a   in  (15)  and  obtain 

(16)  F(x-a  )  =  max  [c,  +  F(x-a  -a.)]  , 

j  :  a   +  a  ,  <  x  -1 

J   r     3   - 

which  can  then  be  substituted  for  the  F(x-a  )  term  on  the 

r 

right  side  of  (15) .   Another  immediate  solution  can  then  be 
produced.   Continue  in  this  manner  until  F(L)  is  found  or 
until  all  values  of  F(x)  that  are  desired  are  found.   Keep- 
ing track  of  which  j  produces  the  solution  will  enable  us 
to  determine  the  optimal  x,  at  the  end.   Only  distinct 

values  of  a.  are  considered.   If  a.  =  a,  and  c .  >  c.  for 
:  j     k       d  -  k 

j  ^  k,  then  take  x,  =  0 . 

The  procedure  may  be  summarized  in  the  following  four 
steps  : 

1.    List  the  values  of  the  problem  as  follows: 
__1 2 3 ,_L1 n_ 

cl     c2     c3     "•      Cn 
al     a2     a3     "••      an 


x.  =  0 
D 

Set  m  =  0.   Go  to  2. 
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2.  Given  the  list  find  a  -   mm   a   for  columns  in  all 

a .  >  m   -1 
D 

sections.   If  a  =  L  go  to  4 .   Otherwise  set  m  =  a 

r     3  r 

and  go  to  3. 

3.  Add  a  new  section  of  columns  to  the  list,  if  possible, 
as  follows: 

Calculate  a'  =  a  +  a.  and  c'  =  c   +  c.  for  t  =  1, 
. ..,n.   Add  a  column  headed  by  t  if: 

(a)  a^.  <  L. 

(b)  a'  is  not  on  the  list. 

(c)  a'  is  on  the  list  and  has  a  corresponding 
c   value  that  is  smaller  than  c' . 

(d)  Underneath  the  section  added  write  the  x. 

values  from  the  section  where  m  =  a  was 

r 

found „   Increase  x  by  one  for  the  new 
section.   Sections  after  the  first  may  be 
deleted  after  they  are  no  longer  needed. 
Go  to  2. 

4.  The  problem  is  solved  with  solution  c  .   The  values 
of  the  variables  are  found  below  the  section  where 
a   =  L  appears,  increase  x  by  one. 

This  completes  the  algorithm.   This  algorithm  has  the 
computational  advantage  of  being  a  single  pass  algorithm  and 
does  not  require  backtracking c 

To  illustrate  this  method  the  following  problem  is  con- 
sidered: 

Max   2x,  +  —3X2  +  5x~ 
when  2x,  +   3x2  +  4x~  =  6. 

xt  Jl  0'  xo        0,  x^  ^  0,  all  integer. 
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1.  We  list  the  values  of  the  problem  as 

12     3 

2    ±°     5 
3     D 

2     3     4 

x.  =  0 

D 

Set  m  =  0.   Go  to  2. 

2.  Given  the  above  list  we  find  a   =  min  a.  =  2.   Set 
m  =  2  and  go  to  3. 

3.  Write  the  new  section  as 

_2 3_ 

ii     7 
3     ' 


X.  a  1. 


4.  We  obtain  min  a.  =  3  in  1.   No  new  section  is 

: 

added. 

5.  We  obtain  min  a.  =  4  in  1.   No  new  section  is 

D 

added* 

6.  The  solution  is  now  evident  in  3,  where  a.  =  6. 

3 

We  thus  have  F(6)  =  7,  x.  =  1,  xo  =  1  as  optimal. 
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6.    Dynamic  Programming  Methods 

The  solution  of  a  linear  program  is  generally  easier 
than  that  of  an  integer  program.   Given  a  linear  program  to 
be  solved  in  integers ,  it  is  tempting  to  solve  the  linear 
program  and  then,  by  some  process,  "round"  the  noninteger 
valued  variables  into  an  optimal  integer  solution.   Partic- 
ularly appealing  results  of  Gomory  [13]  have  led  to  a 
dynamic  programming  process  for  rounding  a  linear  program- 
ming solution  into  an  optimal  integer  solution. 

Two  such  approaches  will  be  presented  in  this  section; 
one  for  the  knapsack  problem  and  the  other,  a  continuation 
of  the  same  method,  for  the  solution  to  a  more  general 
problem. 

The  first  algorithm  by  Greenberg  [16]  is  one  for 
solving 

(17)   Minimize   CX 

Subject  to  AX  =  B 

x.    0  and  integer  (j=l,,..,n), 
where  X  =  (x,  ,...,x  ) ,  C  is  an  n-vector,  B 
is  an  m-vector,  and  A  is  an  mxn  matrix.   It 
is  assumed  the  elements  of  C,  B,  and  A  are 
integers . 
The  linear  programming  solution  to  (17)  transforms 
(17)  to 


(18)   Minimize   d  +  \_    c . 


x 


jeG   3  3 
Subject  to  X.  +   V   a.x.  =  an 


x.    0  and  integer  (j=l,...,n), 
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where  X_  =  {x. |ieG},  c .  >  0 ,  G  is  the  set  of  indices  of  the 
G      1  '        j  — 

basic  variables  and  G  is  the  set  of  indices  of  the  non-basic 

variables.   The  vectors  a.  (j=0  and  jeG)  are  column  vectors. 

1 

The  components  of  aQ  are  non-negative.   If  a~  is  all  integer 

then  x.  =  0  (jeG) ,  X   =  an  is  an  optimal  integer  solution. 

If  any  of  the  aQ  are  fractional  then  (18)  may  be  reduced  to 
an  equivalent  knapsack  problem 

(19)   Minimize    )   c.x. 

jeG   ^  ? 

Subject  to    £   a.x.  =   b (mod  D) 
jeG   :  : 

x  .    0  and  integer, 

where  the  constraint  in  (19)  is  a  congruence  and  D  is  the 

determinant  of  the  coefficients  of  the  x. ,  (ieG)  from  (17) 

or  a  reduced  value.   It  is  assumed  that  c.,  a.  and  b  are 

J        D 

integers.   The  c.  in  (19)  are  the  c.  in  (18)  multiplied  by 

D  1 

D.   The  congruence  in  (19)  is  developed  by  finding  the 
equation  in  (18) ,  including  the  objective  function,  that 
has  any  constant,  written  in  fractional  form,  having  the 
property  that  its  numerator  and  denominator  are  relatively 
prime.   In  this  case  the  denominator  is  D.   Gomory  [14] 
shows  that  if  we  find  a  constant  with  this  property  then 
the  congruence  taken  from  the  equation  where  the  constant 
appears  generates  the  congruences  developed  from  the  other 
equations.   The  cutting  plane  developed  from  the  congruence 
represents  the  best  cutting  plane  since  any  integer  solution 
to  the  congruence  produces  integer  solutions  for  the  x. 
(ieG)  in  (18) . 
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Although  it  may  appear  that  the  search  for  a  constant 
with  the  property  that  numerator  and  denominator  are  rel- 
atively prime  is  a  tedious  one,  there  is  a  simple  and  rapid 
way  to  find  the  equation  containing  the  constant.   The  re- 
vised simplex  method  is  used  to  obtain  the  linear  program- 
ming solution  to  (17)  .   Therefore  the  inverse  matrix  is 
available  to  develop  the  constants  in  (18) .   In  solving  (17) 
the  value  of  D  is  carried  along  as  the  product  of  the  pivot 
elements.   The  desired  equation  is  found  by  finding  the 
greatest  common  divisor  of  the  non-zero  numerators  of  each 
of  the  rows  of  the  inverse  matrix.   The  procedure  is  stopped 
when  the  greatest  common  divisor  is  unity.   If  none  of  the 
rows  produce  a  greatest  common  divisor  of  unity,  the  row 
with  the  minimum  greatest  common  divisor  is  selected.   The 
greatest  common  divisor  of  the  greatest  common  divisors  of 
each  row  also  divide  D  thereby  producing  a  smaller  value  of 
D  by  dividing.   An  enlarged  inverse  matrix  is  also  used  in 
considering  the  objective  function.   The  procedure  in  [5] 
is  used  to  find  the  greatest  common  divisor  of  the  elements 
of  each  row  of  the  inverse  matriXe 

Before  the  above  procedure,  the  Euclidean  algorithm 
is  used  to  examine  the  a0  and  d*   When  a  fractional  constant 
having  unity  as  the  greatest  common  divisor  of  the  numerator 
and  denominator  is  found,  the  procedure  stops.   If  the  re- 
quired row  is  not  found  then  the  inverse  matrix  is  used  as 
described  above. 
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A  problem  which  is  given  in  [3],  to  illustrate  Gomory's 
algorithm,  is  solved  below  by  the  method  just  described. 

(20)  min  +  4x1  +  5x„ 

subject  to       3x.  +   x2  -  x^  =  2 

xl  +  ^x2  ~  x4  =  ^ 
3x.  +  2x~  -  Xj.  =  7 

x.  >  0  and  integer. 

The  continuous  solution  gives  us 

,0,.  112       7      11 

(21)  mm    +  -jg-   +  wx4   +  TUx5 

_2      __4      18 
Xl     10X4    10X5  "  10 

_1      1       8 
X2     10X4  +  10X5  ~  10 

_3      11      £2 
X3     10X4    10X5  "    10 

where  D  =  10. 

112         18    8   42 
Considering  d  =  — =-^-,  afi  =  (ww  t-q,  ttc)  i    we  see  that  none 

have  numerator  and  denominator  relatively  prime.   The  in- 
verse matrix  is 

-2      4 

0    i§     if    ° 

0   I§    TO   ° 

-i   ri   ii   o 


10    10 

-7   -11 

10    10 


0   =J   "Ji   1 


where  the  bottom  row  produces  the  coefficients  in  the  ob- 
jective function.   In  the  first  row  we  consider  the  great- 
est common  divisor  of  (-2,4)  which  is  2.   The  first  row 
produces  the  first  constraint  equation  in  (21) .   In  the 


41 


second  row  we  consider  the  greatest  common  divisor  of  (3,-1) 
which  is  unity.   Thus  the  required  congruence  may  be  obtain- 
ed from  the  second  constraint  in  (21).   Similarly,  the  re- 
quired congruence  may  be  obtained  from  the  third  constraint 
and  the  objective  function,,   Using  the  second  constraint 
we  obtain  the  congruence 

7x.  +  x5  3  8  (mod  10)  . 

The  equivalent  knapsack  problem  becomes 
minimize  7x.  +  llx, 
when     7x.  +    x-  =  8  (mod  10) 


x 


.,  x-    0  and  integer. 


In  general,  once  the  required  equation  in  (18)  is  found, 

e.g.  , 

x.  +   V   a. .x.  =  a.   for  a  single  ieG 
i    ^-      1D  -,     10 

(or  for  the  objective  function)  the  congruence  is  found  as 
in  Gomory  [13]  as 

J   a. .x ,  =  a .  n  (mod  1) 

jiG   l3  3     l0 

where  a. .  is  the  fractional  part  of  a.  ,.      Multiplying 

through  by  D,  we  obtain 

I      ax,  5b  (mod  D) 
jeG  :  : 

where  a   =  a,.D,  b  =  a^D  . 

We  are  now  interested  in  a  solution  to  the  equivalent 

knapsack  problem  which  is  in  the  form  of  (19).   We  can 

assume  that  no  value  of  a   appears  more  than  once  (if  not, 

we  can  select  the  one  with  smallest  c,  value).   Writing 

3 
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F(y)  =  min 


n 


n 


I      C.x. |  I      a.x   =  y  (mod  D) 

-i=i  J  ^  i=1  :  : 


We  obtain  the  recursion  as  in  [9] 

(22)  F(y)  =  min  (c.+F(y-a.)) 

with  F(0)  =  0.   The  arguments  of  F  are  taken  modulo  D.   We 
can  write  (22)  as 

(23)  F(y)  =  cr  +  min  (c . -cr+F (y-a . ) ) 

where  c  =  min  c..   Equation  (23)  has  an  immediate  solution 
r        i     ^ 
3         J 

for  y  =  a   and  we  obtain  F(a  )  =  c  .   We  then  write  (2  3)  as 

(24)  F(y-ar)  =  cr  +  min  (c . -cr+F(y-ar~a . ) )  . 

We  substitute  (24)  for  the  F(y-a  )  term  on  the  right  side 

of  (23)  and  produce  another  solution  to  some  F(a.).   We  stop 

when  we  have  achieved  a  solution  for  F(b).   We  also  keep 

track  of  the  variable  j  which  produces  each  solution  and 

then  backtrack  to  find  the  x..   This  entire  procedure  can 

3 

be  summarized  in  the  following  algorithm: 
1.   List  the  values  of  the  problem  as  follows: 
1     2     3     ...    n 


C  f  c 

cl    "2        c3 


n 


al    a2 


n 


Go  to  2 . 
2.   Given  the  list 
12     3 


n 


cl    c2    C3 


n 


c; 


al    a2    a3 


n 
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find  c  =  min  c   for  all  unmarked  columns.   Set 
r        J 

F(a  )  =  c   and  I (a  )  =  r,  where  a   and  r  are  corres- 
ponding elements  to  c   in  the  column.   If  a   =  b  go  to 
4.   Otherwise  mark  the  column  if  it  is  one  of  the  first 
n»   Go  to  3c 

3.  Add  columns  to  the  list,  if  possible,  as  follows: 

Calculate  a'  =  a   +  a.  (mod  D)  and  c!  =  c   +  c,  for 
t    r     t  t    r    t 

t  =  l,...,h.   Add  a  column  headed  by  t  if: 

(a)  F(a-P  ^as  not  been  found0 

(b)  a'  is  not  on  the  list, 

(c)  a'  is  on  the  list  and  has  a  corresponding  c 
value  that  is  larger  than  c' . 

Delete  columns  (beyond  the  first  n)  having  elements  a' 

(d)  after  F(a')  is  found. 

(e)  after  a  new  a'  is  found  as  in  3(c). 
Go  to  2 . 

4.  The  problem  is  solved  with  solution  F(b)»   The  values 
of  the  variables  are  found  as  follows: 

(a)  Set  x.  ■  0,  j  -  l,,c,,n  and  y  =  b.   Go  to  4(b). 

(b)  Look  up  l(y)  =  j.   Set  x.  =  x.  +  1.   Go  to  4 (c) . 

D     3 

(c)  Set  y  =  y  -  a.  (mod  D) „   If  y  =  0  go  to  5. 
Otherwise  go  to  4 (b) . 

5.  End.   The  final  x,  values  are  the  required  ones. 

This  completes  the  algorithm ,   If  solutions  are  desired 
for  all  values  of  y  then  the  algorithm  can  be  continued  in- 
stead of  stopping  when  b  is  reached.   Continuing  with  our 
example  and  using  the  algorithm  of  Greenberg  [16]  ,  the 
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equivalent  knapsack  problem  is 
Minimize 
Subject  to   7x.  +    X-    8  (mod  10) 


7x4  +  llx5 


we  list 


x.r    x5  _>  0  and  integer, 


5 
11 

1 


Thus  7  =  min  c,  F(7)  =  7,  1(7)  =  4.   The  list  becomes 
(Marking  the  first  column) 


4 

5 

4 

5 

7 

11 

14 

18 

7 

1 

4 

8 

* 

Thus  F(l)  =  11, 

1(1) 

=  5. 

The  1 

ist 

becomes 

4 

5 

4 

5       5 

7 

11 

14 

18      22 

7 

1 

4 

8       2 

* 

* 

F(4)  =  14,  1(4) 

= 

4. 

The 

list  b 

e comes 

4 

5 

4 

5       5 

7 

11 

18 

22      25 

7 

1 

8 

2       5 

* 

* 

F(8)  =  18,  1(8)  =  4.   We  stop. 
Backtracking   1(8)  =  4,  x.  =  1 

I (1)  =  5 ,  x_  =  1 ,  end. 
The  solution  is  F(8)  =  18,  x,  =  1,  x5  =  1 
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Approximately  2  5  problems  have  been  tried  using  this 
method  [16]  where  there  was  a  maximum  of  2000  variables  and 
150  equations-   The  method  was  used  to  solve  integer  pro- 
grams arising  as  covering  problems .   Usually  the  method 
produces  an  immediate  integer  solution .   If  the  knapsack 
solution  does  not  produce  feasible  (positive)  integers  to 
the  problem ,  success  has  always  been  obtained  by  adding  a 
single  cut. 

The  above  algorithm  has  been  extended  by  Greenberg  [171 
for  integer  solutions  to  bounded  variable  linear  programs. 
As  previously,  the  continuous  linear  programming  solution 
is  first  found.   If  the  continuous  solution  is  fractional 
then  a  linear  congruence  is  added  as  a  constraint.   The 
problem  is  then  put  into  a  dynamic  programming  format  and 
the  optimal  integer  solution  found. 

The  algorithm  presented  is  for  solving 

(25)   Minimize    CX 

Subject  to   AX  =  B 

0  <  x.  <  b„,  x.  integer,  j=l,...,n, 
-3-33 

where  X  =  (x, , . „ . ,x  ) ,  C  is  an  n-vector,  B  is  an  m-vector, 
A  is  an  mxn  matrix  and  the  b,  are  integers.   It  is  assumed 
the  elements  of  C,  B,  and  A  are  integers.   In  this  formula- 
tion the  b-  may  be  infinite.   This  algorithm  also  includes 
the  case  where  the  x,  are  restricted  to  be  either  zero  or 

: 

one. 

A  bounded  variable  linear  programming  technique  is 
used  to  obtain  the  linear  programming  solution  to  (25) . 
This  transforms  (25)  to 
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(26)   Minimize   d  +   T   c.x. 

jcG   =>  ' 

XG  +  Jg  -^  =  -0' 

0  _<  x .  :  b.,  x.  integer,  j=l,...,n, 

where  the  vector  X_  =  {x.  ieG),  G  is  the  set  of  indices  of 
the  basic  variables,  and  G  is  the  set  of  indices  of  the  non- 
basic  variables.   Further,  some  of  the  non-basic  variables 
may  be  at  their  upper  bounds  in  the  continuous  solution  of 
(25).   For  those  variables  their  corresponding  c.  values 
are  non-positive.   Also,  c .  _>  0  for  non-basic  variables  that 
are  at  the  zero  value.   For  ease  of  computation,  we  make 

the  transformation  x1.  =  b.  -  x.  for  those  non-basic  var- 

j     J     3 

iables  at  their  upper  bound.   Thus  we  may  assume  a  form 
like  (26)  with  all  c .  >_  0  and  all  non-basic  variables  at 
zero  values.   The  vectors  a.(j=0  and  jeG)  are  column  vec- 
tors.  The  components  of  aQ  are  non-negative.   If  aQ  is  all 
integer  then  x.  =  0  (jeG)  ,  X  =  ctQ   is  an  optimal  solution 
(if  any  of  the  x.,  jeG  are  really  the  x'.  under  the  trans- 
formation, then  x.  -   b . ) .   If  any  of  the  aQ  are  fractional, 
problem  (26)  is  converted  to  the  problem: 


(27)   Minimize   £_  c.x 


jeG   D  3 


when       J   a.x.  <  a 


jeG  3    J 

J   a ,x .  e  b  (mod  D) 
jeG  3    3 

0  <  x.  <  b.,  x.  integer,  jeG. 
-  J  -  J    J     *    J 
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The  inequality  constraint!  in  (27)  are  obtained  from  U6) 
by  dropping  the  x .  ,  in,   D  is  the  d<  leunlnant  of  the  co- 
efficients of  the  x,  >    jtu  from  (25),   The  value  of  D  may 
be  found  as  the  product  of  the  pivot  elements  during  the 
simplex  procedure  for  obtaining  the  continuous  solution  of 
(25).   The  linear  congruence  in  U1)    is  a  single  congruence 
where  the  a.  and  b  are  integers.   The  congruence  results 
from  the  requirement  that  all  xjf  \    Q,   be  integers. 

After  finding  the  congruence  in  (27)  a  dynamic  program- 
ming formulation  of  (27)  is  developed*   Writing 

F(x,a,8)  *  min  \     c.xJ  \     o.x,  <  a  , 
Ij eG  3  3  j  &G  J  J 

I     a4x    x  (mod  D) ,  0  <  e,x,    g 
UQ      3  3  3  3" 

the  dynamic  programming  recursion 

(28)   F(x,ot,B)  -min  (c  .+F(x-a  .  ,a-a.  ,  g-e  . )  ) 

j&G    '       3     3     J 

F(0,tt,B)  -  0  fur  a  ^  0,  0  >  0, 
is  obtained.   The  x  argument  of  F  is  taken  modulo  D.   The 
vector  e,  is  composed  of  a  unit  element  with  the  other  el- 
ements zero.  The  unit  element  corresponds  to  the  unit  co- 
efficient of  x,  in  x,  ^h,.   it  is  assumed  that  only  fea- 
sible values  of  x,  a,  and  B  are  used  in  (2  8)  . 

One  immediate  solution  to  (23)  can  be  obtained  by 
finding  g£   *  min  e  .  This  produces  F( ■< t  ,  <(  ,e^)  ■  c^.  Then 
replace  x  by  x  •  s  ,  a  by  a  ■  a  .  and  H  by  I  -  e  in  (28) 
and  substitute  the  result  for  the  F(x-af/a-otf,$-eff)  term  on 
the  right  side  of  (2  8) ,  then  another  immediate  solution  can 
be  produced.  Continue  this  way  unti  i  B*(b,a,£)  is  found 
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where  0  <  an   -   a  <   b_  and  3  <  b-  where  the  vector 

—    U         - ■    (j  —    Li 

b_  =  {b.|ieG>  and  the  vector  b^  =  {b.|ieG}.   This  entire 
procedure  is  contained  in  the  following  algorithm: 

1.   Suppose  the  indices  in  G  are  (l,2,...,m),  list 
the  values  of  the  problem  as 

1    2     3  m 


cl 

C2 

C3 

•    •    • 

c 

m 

al 

a2 

a3 

•    •    • 

m 

al 

a2 

a3 

•    •    m 

a 
m 

X  . 

3 

=    0 

Go  to  2. 

2.  Given  the  list,  find  c  =  min  c.  for  all  unmarked 

columns  in  all  sections.   If  a  =  b  and 

0  <  an   -   a.     <  b_  go  to  4 .   Otherwise  mark  the 
—  0    r  —  G  * 

column  and  go  to  3. 

3.  Add  a  new  section  of  columns  to  the  list,  if  pos- 
sible, as  follows: 

(a)  calculate  c'.  =  c  +  c . ,  a'.  =  a  +  a., 

3  r    :   D    r    j 

a!  =  a  +  a.  (mod  D)  for  all  values  of  jeG 
j  r    j  J 

(i.e.,  values  j,  c,  a.,  a.  are  taken  from 
the  list  in  step  1.)   where  x .  <  b .  for 
j  5*  r  and  where  x  +  1  <  b   for  j  =  r  for 
the  section  containing  the  newly  marked 
column. 

(b)  add  the  column  headed  by  j  in  the  new  section 

with  values  c'.  ,  a'  and  a'.. 
3        j       3 
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(c)   Underneath  the  section  added  write  the  x, 

: 

values  from  the  section  containing  the  newly 
marked  column.   Increase  x  by  one  for  the 
section   When  columns  in  new  sections  become 
marked  they  may  be  deleted  after  the  calcula- 
tions are  made  and  the  new  section  is  added 
to  the  list,   A  new  column  may  already  be  on 

the  list.   It  need  not  be  added  if  the  x. 

J 

values  in  corresponding  sections  would  co- 
incide (after  increasing  the  x.  values  by  one 
for  the  j  heading  values  of  the  two  columns) . 
Go  to  2. 
4.   The  integer  problem  is  solved  with  objective  func- 
tion value  d  +  c  .   The  values  of  the  basic  var- 

r 

iables  in  (26)  are  X-  =  aA  -  a  .   The  values  of 

G     0     r 

the  non-basic  variables  are  found  below  the  section 
where  a  =  b  appears;   increase  x  by  one. 
This  completes  the  algorithm.   The  algorithm  may  be 
simplified  by  calculating  a'  only  when  a\    =■   b  by  using  the 
proper  x.  values  and  the  a-  from  step  1.   An  integer  solu- 
tion is  sure  to  be  found  because  all  integer  solutions  to 
the  congruence  in  (27)  are  systematically  produced  in  order 
of  increasing  objective  function  value. 
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To  illustrate  this  procedure  we  use  the  problem  given 
in  [2]  as 


Minimize 

5x1 

+ 

7X2 

+ 

10x3 

+ 

3x4 

+ 

X5 

when 

xi 

- 

3x2 

+ 

5x3 

+ 

X4 

- 

4x5 

> 

2 

-2x, 

+ 

6x2 

- 

3x3 

- 

2x4 

+ 

2x5 

> 

0 

- 

x2 

+ 

2x3 

- 

x4 

- 

X5 

> 

1 

0  _<  x.  £  1,  x.  integer,  j=l,...,5. 

We  introduce  surplus  variables  xg  >_   0 ,  x_  _>  0 ,  and  xg  >^  0 
(i.e.,  with  °°  as  upper  bounds)  and  find  the  continuous 
solution  and  equivalent  problem: 
(29)   Minimize 

9  +  2!x  +  i|ix    +  iix  +i4  Ulx 

y     9  1         9  X4     9  5      +  ^x7  +  ^^x8 

when 

7  28      13  1         11 

9X1      "    9X4  +   9X5    X6 

2  8      4 

9X1  +  x3      9X4  "   gx5 

4  7      1 

9X1  +  x2      9X4  +   9X5 

0  _  x.    1,  x.  integer,  j=l,...,5 

0  <_   x  .  ,  j  =  6  ,7,8. 
We  have  D  =  9.   The  second  equation  produces  the  congruence 

7x1  +  x4  +  5x5  +  8x_  +  3xg  =  6  (mod  9) 
which  is  added  as  a  constraint.   Multiplying  through  by  9 
where  applicable,  we  list 


+  gX? 

3X8 

~  3 

-  ix 

9X7 

- 

2 

3X8 

2 

3 

2 

9X7 

+ 

3X8 

1 
3 
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(30) 


9 

93 

r.c 

42 

24 

137 

3 

-7 

-28 

13 

1 

-3 

i 

-2 

M 

-4 

-1 

-6 

3 

-4 

-7 

1 

-2 

3 

i 

7 

1 

5 

8 

3 

* 

* 

*i 

a  0 

F©f  ©©nvenienee  we  include  at  the  left  of  the  list  the 
©tejeetive   function  value ,   the  fight  hand  sides    (multiplied 
by  f)    f©j?  the  equalities   in   (29)  ,   and  the  right  hand  side 
f©£  the  @ong£U@ne@*     We  have  24  *  win  ©.,   i.e.,   c£  «  24, 
with  ¥  ■  ?•     We  add  the  eeution 

(3D  14         17  8 


117 

ISO 

61 

41 

ill 

-6 

=  27 

14 

2 

-2 

=  1 

* 

-1 

-2 

-7 

-§ 

9 

-1 

-4 

1 

§ 

<> 

4 

7 

2 

* 

•  *  - 

X7  "  1 

We  rnaik  the  7  SQlumn  in   (30)  •  We  have  min  c,   *  42  torn 
(19) i  we  add  the  §e@ti@n 

(32)                       1           4  S 

Hi       ill  171 

§       -13  10 

-6       -12  -10 

O          -6  4 

3 I 


KB    a 


We  need  not  add  a  column  headed  by  7  in  (32)  because  it 
would  duplicate  the  5  column  in  (31)  (the  use  of  either 
column  would  require  x,-  =  1  and  x7  =  1)  .   We  do  not  add  a 
5  column  in  (32)  since  x,-  would  be  at  its  upper  bound  in 
(32).   We  mark  the  5  column  in  (30).   We  have  min  c.  =  48 
in  (31)  .   We  add  the  section 
(33)       1     4 5 


141 

204 

90 

72 

185 

-5 

-26 

15 

3 

-1 

-4 

-10 

-6 

-3 

-8 

-8 

-11 

-3 

-6 

-1 

5 

8 

3 

6 

1 

X7 

=  2 

We  mark  the  7  column  in  (31) .   We  have  min  c.  =  66  from 
(31) .   We  add  the  section 
(34) 


159 

222 

203 

-7 

-14 

11 

-7 

-13 

-11 

-5 

-8 

2 

2 

5 

7 

xl   -  1, 

x5  = 

1 

We  mark  the  5  column  in  (31).   The  solution  is  now  apparent 
in  the  7  column  in  (33) .   We  have  the  optimal  solution 
x?  =  3,  xg  =  (3-3)/9  -  0,  x3  =  (6+3)/9  =  1 ,  x2  =  (3+6)/9  =  1; 
the  value  of  the  objective  function  is  9  +  72/9  =  17. 
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7.    Summary 

Since  1954,  the  field  of  integer  programming  has  made 
rapid  progress.   Many  new  approaches  have  been  tried  on 
various  type  problems  with  varying  amounts  of  success.   The 
developments  in  computers  have  enabled  many  problems  to  be 
solved  today  that  fifteen  years  ago  could  not  be  handled. 
Many  computer  codes  have  been  developed  around  the  algor- 
ithms presented  here.   Information  on  computational  expe- 
rience with  these  codes  is  scarce  and  publications  in  this 
area  are  lacking.   The  little  information  that  is  available 
indicates  there  is  much  to  be  tried  and  certainly  room  for 
clever  imaginative  schemes  for  solving  this  type  of  prob- 
lem.  Possibly  the  best  approach  or  method  for  solution 
will  be  a  scheme  employing  all  of  the  categories  described 
in  this  thesis. 
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